Data packet classification

ABSTRACT

A method of classifying data packets based on general property ranges. An interval tree is constructed to represent the applicability of rules to non-overlapping ranges of a data classification property. The interval tree can be a binary tree such as a balanced binary tree or red-black tree. To determine which rules apply to a data packet, the data packet property, for example a field in a data packet header, is compared to the intervals in the tree to find a match.  
     To balance the time and space complexity, a heuristics based method is used for classifying data packets based on general property ranges of more than one data classification property. An interval tree is constructed for a first data classification property. If the number of rules potentially applicable to the data packet based on an interval of the first tree exceeds a threshold, that interval will refer to a second interval tree representing the applicability of the rules to non-overlapping ranges of the second data classification property. If the number of potentially applicable rules does not exceed the threshold, the interval refers to an ordered list of rules that are searched through to find a match.

[0001] This description relates to data packet classification.

BACKGROUND

[0002] Typical network administrators desire the ability to control the processing of information based on its properties, for example, to give higher or lower priority to packets of data that have certain properties. A user may have exceeded an allotted usage, and thus the administrator may want packets originating from him to be given a lower priority when traveling through the network. Likewise, it may be of high importance that data from a certain source reach a certain destination, and the administrator will want this reflected in the priority given to these data.

[0003] Components between two points on a network process packets of data based on the properties of those data packets. These properties may be, but are not limited to, fields in the headers of the data packets. Such properties may include, but are not limited to, the source address of the data packet, the destination address, the protocol used by the data packet (such as TCP or UDP), and/or ports. For example, a router 10, as shown in FIG. 1, can perform the function of routing data from one piece of a network, or subnet 12, to a second subnet 14. By comparing the destination address of a data packet to a routing table, the router 10 determines where to send the data.

[0004] As shown in FIG. 2, filters 16 can be employed to aid in the processing of the data packets. By using masking techniques, or blocking out certain portions of data packet properties (such as a certain portion of the destination address), it is possible to determine the source or destination subnet of the packet. Thus the data packet can be classified and action can be taken based on which subnet it originated from or was destined for. Likewise, a packet could be classified by comparing it to a single port or to the set of all ports.

[0005] Specialized hardware solutions can be used to classify data packets based on property ranges that do not fit into these clearly delineated categories. For example, data packet classification based on an address range that spans more than one subnet can be implemented with hardware that can logically “and” a set of 32-bit integers and indicate the first bit position that is set in all of the 32-bit integers.

DRAWINGS

[0006]FIG. 1 is a block diagram of a network;

[0007]FIG. 2 is a block diagram of a router interfacing with subnets;

[0008]FIG. 3 is a block diagram of a router interfacing with subnets;

[0009]FIG. 4(a) is a tree data structure for a set of rules;

[0010]FIG. 4(b) is the set of rules corresponding to the tree data structure of FIG. 4(a);

[0011]FIG. 5 is a flowchart of a method of searching a tree data structure;

[0012]FIG. 6 is a flowchart of a heuristics based method of generating a tree data structure;

[0013]FIG. 7(a) is a tree data structure for a set of rules;

[0014]FIG. 7(b) is the set of rules corresponding to the tree data structure of FIG. 7(a); and

[0015]FIG. 8 is a flowchart of a method of searching a tree data structure.

DETAILED DESCRIPTION

[0016]FIG. 3 shows a system 18 for classifying data packets based on general property ranges. A network device, such as a router 10, manages the flow of data packets to and from different subnets (i.e. 12, 14) on a network. The router 10 includes a data classification module 20 for classifying data packets based on rules that are provided by a rule module 22. The data classification module 20 interprets the rules by constructing a data structure, such as a tree data structure 24, that represents the rules. A rule can be a condition and a corresponding result, such as “if the packet's header value for source address matches a certain range, then encrypt the packet using this algorithm and key.” A rule can be implemented by a filter 16. In the above example, the condition would be the filter 16, where the filter specifies values to compare against the packet's header values to determine if there is a match. The rule would then be “if the packet matches this filter (i.e. the source address is in the range specified by the filter) then apply the corresponding result.” To satisfy the rule, the appropriate value in the header of the packet must be within the range designated by the corresponding filter.

[0017] The tree data structure can be implemented in a computer memory, or transmitted as a data signal embodied in a carrier wave. A data packet is compared to the rules, as represented by the tree data structure 24, to see which rules apply to it. The data packet is tagged to represent the applicability of the rules, and processed accordingly.

[0018] Typical data classification properties are the source and destination addresses of the data packet. A general range of source or destination addresses includes ranges that do not entirely encompass a subnet as well as ranges that span more than one subnet or portions thereof. Another typical data classification property is a port designation. General port ranges includes those with more than one port, but not necessarily all ports. Still another example of a typical data classification property is Internet Protocol (IP) type, such as TCP, UDP, or wild-carded. Various other data classification properties can also be used.

[0019] A tree data structure 26, as shown in FIG. 4(a), represents a set of rules, shown in FIG. 4(b), as a set of non-overlapping intervals. In this example, a binary tree is used, and each node of the tree represents a range, or interval, of source addresses 28 and a subset of rules 30 that apply to that range of addresses. The top of the tree is the root interval 32. The root interval 32 is roughly the median interval, and the leaf intervals are those nodes that do not have any nodes branching from them. The root interval 32 is determined by an algorithm that is used to keep the binary tree balanced, where the distance between the root interval 32 and any leaf interval is not too far when compared to the distance between the root interval 32 and other leaf intervals. If the rules change such that an interval is added or removed, the tree may need to be rebalanced and the root interval 32 may change.

[0020] A left child interval 34 represents an interval in which the addresses are lower than the start of the root interval 32. A right child interval 36 represents an interval in which the addresses are higher than the end of the root interval 32. Each of these child intervals might be a parent interval for another pair of child intervals 38 and 40, 42 and 44. In the case of intervals for ranges below the range of the root interval, the left child interval 38 represents an interval in which the addresses are lower than the start of the first child interval 34, while the right child interval 40 represents addresses between the first child interval 34 and the root interval 32. In the case of intervals for ranges above the range of the root interval, the right child interval 44 represents an interval in which the addresses are higher than the end of the first child interval 36, while the left child interval 42 represents addresses between the first child interval 36 and the root interval 32. Successive levels of child intervals are constructed similarly.

[0021] When a data packet is received, it is compared to the tree structure as shown in FIG. 5. The data classification property of the data packet is compared to the root interval 32. If the value of the packet property is lower than any of the values in the root interval (502) and a left child interval exists (504), the left child interval is assigned as the current interval (506). If no left child exists, the packet property value does not fit in any interval, and the packet satisfies none of the rules (508). If the value of the packet property is higher than any of the values in the root interval (510), and a right child interval exists (512), the right child interval is assigned as the current interval (514). If no right child exists, the packet property value does not fit in any interval, and the packet satisfies none of the rules (508). If the packet property value is not greater or less than any value in the root interval, then it must be in the root interval. The packet thus satisfies the rules corresponding to that interval (516). If either a right or left child interval was assigned as the current interval, then the comparison is repeated for that interval (518). Similar iterations are made, until it is determined that the packet property value either fits in an interval (516), or fits in no interval (508).

[0022] If the data packet satisfies one or more rules, it is tagged appropriately based on which rules it satisfies. One way to do this is for each interval to have a way of representing the filters that match a particular interval. For example, the interval the data packet matched can correspond to a set of filter IDs or a bit vector indicating which filters are matched to the interval. The data packet will then be processed by one, some, or all of the rules to which it is matched. For example, the packet may be given a higher or lower priority based on the rules it satisfied, and thus will be scheduled differently than packets satisfying different rules. If the data packet satisfied none of the rules, it will not be tagged, and thus will not be processed according to the rules.

[0023] The tree-structure used determines the time complexity of a search through the tree. For example, the tree can be a balanced binary tree with n intervals. The time complexity of a one-property balanced binary tree, where no leaf interval is more than a certain amount farther from the root interval than any other leaf interval, can be on the order of log n. Another example of a tree-structure is a red-black tree, where no leaf interval is more than twice as far from the root interval than any other. The time complexity of a red-black tree with n intervals can be on the order of 2 log n. Therefore, if the rule set included 1000 non-overlapping intervals, it would take at most 10 comparisons for a balanced binary tree and at most 20 comparisons for a red black tree to locate the matching interval.

[0024] For rules that encompass more than one data classification property, trees can similarly be generated for each of the other data classification properties. Each of these trees can be searched separately. Alternatively, each interval in the first tree can include a reference to a tree for a second data classification property, each interval in the second tree can include a reference to a tree for a third data classification property, and so on.

[0025] A data packet would be compared to each of these trees, and would be tagged appropriately based on which rules it satisfied for each of the data classification properties. One way to do this is for each interval to have a way of representing the filters that match a particular interval. For example, the interval can be matched to a set of filter IDs or a bit vector indicating which filters are matched to the interval. For each data classification property in which a data packet matches an interval then, there is a potential set of filter matches indicated by the filter IDs or bit vector. It is then determined which filters are indicated by all of the intervals that are matched. This can be done, for example, by doing a set intersection of the rule sets, or logically “and”ing the bit vectors. It may be necessary to dedicate hardware to logically “and”ing bit vectors.

[0026] As the number of characteristics compared increases, the number of tree intervals also increases. This results in increased consumption of computing resources, such as memory, in order to decrease the amount of time it takes to compare the properties to the rules (time complexity). The consumption of memory can be referred to as space complexity. For example, an ordered list of filters can require 4 bytes of memory per rule. Intervals in the interval set, on the other hand, can require more than 32 bytes each. And there are potentially twice as many intervals as there are rules for the interval set. A balance between the time complexity of the search and the space complexity can be struck by using a heuristics based approach to searching.

[0027]FIG. 6 shows a method of constructing a tree structure for more than one data classification property. First, an interval tree is created for a first data classification property (600). For each interval in the first tree, if the number of rules that could potentially apply for that interval is high (e.g., exceeds a threshold number of rules), then that interval will refer to another tree data structure representing a second data classification property (602). This threshold value can also be heuristically determined. For example, the size of the trees and the number of intervals can be monitored. If the amount of memory consumed by them grows too large, the threshold can be adjusted. Thus the threshold can be dynamically changed as the rules change, to maintain the desired balance of time and space complexity. This heuristic determination can be performed by software.

[0028] If, on the other hand, the number of rules that potentially apply is small (e.g., does not exceed the threshold) then searching one-by-one through an ordered list of rules to see which ones apply for each data classification property will not be time intensive. Thus it is unnecessary to create a tree structure for another data classification property. Instead, the interval will refer, to an ordered list of rules (604). If the tree structure is to represent more than two data classification properties, this method is repeated for each of the intervals of the trees created in 602 (606).

[0029] An example is shown in the tree data structure in FIG. 7(a), which corresponds to the rules in FIG. 7(b). A first tree structure 26 is generated for the rules as they correspond to a source address data classification property. In this example, the threshold number of rules is chosen to be three. The root interval of the first tree 32 is an interval where four rules 30 could potentially apply. This interval then refers to a second tree data structure 46 for a second data classification property, here, destination address. None of the other intervals in the first tree indicate that more than three rules potentially apply. They then contain references to ordered lists of rules 48.

[0030]FIG. 8 illustrates a method of heuristically comparing multiple data packet properties to a tree structure. First, the data packet is compared to a tree structure for a first data packet property (800). It is determined whether the first data packet property matches an interval in the first tree structure. This portion of the method is similar to that shown in FIG. 5, and is represented by shaded boxes in FIG. 8 (802). If the first property of the data packet does not match any interval of the first interval tree, then no rules match the data packet (804). If there is an interval in the first tree that matches the first property of the data packet (806), the packet is compared to a second data packet property (808). If the matching interval in the first tree indicated that the packet could satisfy a number of rules equal to or less than the threshold value, that interval will not refer to any other tree structures. Instead, it will refer to an ordered list of rules (810). The second property of the data packet, as well as any other properties being tested, will be compared to the ordered list of rules to find a match, if any. The rules that match the data packet will determine how the data packet is processed. If there is no rule that matches all of the, data packet properties, then no filters match the data packet (804).

[0031] If the interval in the first tree indicated that the packet could satisfy a number of rules greater than the threshold, that interval will refer to a second non-overlapping tree structure representing the second data packet property (812). The data packet is compared to the second interval tree in a similar manner as for the first interval tree (802). If there is no rule that matches all of the data packet properties (804), then no filters match the data packet. If there is an interval in the second tree that potentially matches, and there is no third property to be tested, then the data packet matches the set of rules in the second interval (806). If there is a third property to be tested, the interval will either refer to another tree, or an ordered list (810 or 812). As described above, this depends on the number of potentially applicable rules compared to the threshold value. This method is repeated until it is determined that either a set of rules matches each property of the data packet (814), or that no rules match all the properties of the data packet (804).

[0032] In the worst case, the space complexity of this method is on the order of n^(m), where n is the number of rules, and m is the number of data classification properties. However, it is likely to be much lower than this. The worst case assumes that every rule overlaps every other rule. In general, though, only small subsets of the rules overlap, because, in practice, the rules have a low degree of correlation. The interval tree for the first data classification property will primarily contain intervals that refer to ordered lists of rules rather than interval trees. Thus the space complexity will likely be much less than n^(m). In the worst case, the time complexity of the method is on the order of (m log n). The time complexity, as described above, depends on the tree-structure used, such as a balanced binary or red-black tree structure.

[0033] Any of the data classification properties could serve as the first data classification property for which a tree is generated. However, the determination of the first data classification property can be made by examining the real-world usage of the filters. Thus the first property can be chosen to minimize the complexity of the overall tree structure. For example, it might be the case that there are a small number of protocol values that will be used. Choosing protocol value as the starting data classification property may then reduce the size and complexity of the tree structure as compared to a tree in which the starting data classification property encompassed more non-overlapping ranges.

[0034] Other embodiments are also within the scope of the invention. 

What is claimed:
 1. A method of data packet classification comprising: determining an interval, from a non-overlapping interval tree representing applicability of rules to a first data packet classification property; and classifying the data packet based on the rules that apply.
 2. The method of claim 1 also including: for a second property, determining an interval from a non-overlapping interval tree representing applicability of rules to a second data packet classification property.
 3. The method of claim 1 also including: for each interval for which the applicability of rules exceeds a threshold, determining an interval from a non-overlapping interval tree representing applicability of rules to a second data packet classification property; and for each interval for which the applicability of rules falls below the threshold, determining the rules that apply for the second property from a list.
 4. The method of claim 2 also including: for additional properties, determining intervals from non-overlapping interval trees representing applicability of rules to the data packet classification properties.
 5. The method of claim 1, also including processing the data packet based on the classification.
 6. The method of claim 5, also including scheduling the data packet based on the classification.
 7. The method of claim 1, in which the first property comprises an IP protocol property.
 8. The method of claim 3, in which one of the properties comprises a source address property.
 9. The method of claim 3, in which one of the properties comprises a destination address property.
 10. The method of claim 1, in which the rules include a relationship between filters and data processing procedures.
 11. A system comprising: a packet classification rule set; and a packet classification module to compare a data packet property to the rule set, the packet classification module including a tree of non-overlapping intervals representing the applicability of the rule set to ranges of the property.
 12. The system of claim 11 in which the packet classification module also includes a second tree of non-overlapping intervals representing the applicability of the rule set to ranges of a second data packet property.
 13. The system of claim 12 in which the packet classification module,also includes an iterative analyzer for analyzing the applicability of the rule set to the second data packet property for packets where the number of rules applicable to the first property is below a threshold value.
 14. The system of claim 11, also including filters for processing the data packet based on the rule set.
 15. Computer software embodied in a carrier signal, the computer software comprising: a tree of non-overlapping intervals representing the applicability of rules to ranges of a data packet property.
 16. The computer software of claim 15, also including a second tree, referred to by an interval of the first tree, in which the second tree represents the applicability of rules to ranges of a second data packet property.
 17. The computer software of claim 15, also including an ordered list of rules referred to by an interval of the first tree.
 18. An article comprising: a storage medium having stored thereon instructions that when executed by a machine results in the following: a tree of non-overlapping intervals representing the applicability of rules to ranges of a data packet property.
 19. The article of claim 18, also including instructions that when executed by a machine results in the following: a second tree, referred to by an interval of the first tree, in which the second tree represents the applicability of rules to ranges of a second data packet property.
 20. The article of claim 18, also including instructions that when executed by a machine results in the following: an ordered list of rules referred to by an interval of the first tree.
 21. Computer software embodied in a carrier signal, the computer software comprising: instructions for defining a set of intervals representing the applicability of rules to a first data packet classification property; instructions for applying a second set of intervals, representing applicability of the rules to a second data packet classification property, for each interval in the first set of intervals for which the applicability of rules exceeds a threshold; and instructions for iteratively determining the applicability of the rules to the second data packet classification property for each interval in the first set of intervals where the number of applicable rules does not exceed the threshold.
 22. The computer software of claim 21, also including instructions for defining a tree structure of intervals.
 23. The computer software of claim 21, also including defining a binary tree structure of intervals.
 24. An article comprising: a storage medium having stored thereon instructions that when executed by a machine results in the following: defining a set of intervals representing the applicability of rules to a first data packet classification property; applying a second set of intervals, representing applicability of the rules to a second data packet classification property, for each interval in the first set of intervals for which the applicability of rules exceeds a threshold; and iteratively determining the applicability of the rules to the second data packet classification property for each interval in the first set of intervals where the number of applicable rules does not exceed the threshold.
 25. The article of claim 24, also including instructions that when executed by a machine results in the following: defining a tree structure of intervals.
 26. The article of claim 24, also including instructions that when executed by a machine results in the following: defining a binary tree structure of intervals.
 27. A method comprising: defining intervals representing applicability of rules to a first data packet classification property; for each interval for which the applicability of rules exceeds a threshold, defining intervals representing the applicability of the rules to a second data packet classification property; and for each interval for which the applicability of the rules does not exceed the threshold, defining a list of the applicability of rules to the second data packet classification property.
 28. The method of claim 27, including searching a binary tree of intervals.
 29. The method of claim 27, also including searching a red-black tree of intervals.
 30. The method of claim 27, also including redefining intervals when the rules change. 